P-3112-US 

A DEVICE AND SYSTEM FOR EST VIVO IMAGING 



FIELD OF THE INVENTION 

The present invention relates to an in vivo imaging device and system 
5 such as for imaging the digestive tract 



BACKGROUND OF THE INVENTION 



Among known in vivo measuring systems are endoscopes, which are 
10 often utilized to provide images of the upper or lower gastro-intestinal tract 
However, endoscopes do not provide views of the entire length of the small 
intestines. Additionally, they are uncomfortable, may cause damage to the patient 
and are complex to operate. 

Swallowable electronic capsules which are moved through the digestive 
15 tract through the action of digestion and which collect data and transmit the data 
to a receiver system are known, one such example is the *'Heidelberg l! capsule. 
Yet another example is a capsule disclosed in US 5,604,531 . These capsules may 
be utilized to measure pH, temperature and pressure throughout the intestines. 
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SUMMARY OF THE INVENTION 

The device and system of the present invention enable obtaining in vivo 
5 images from within body lumens or cavities, such as images of the entire length 
of the gastrointestinal (GI) tract. The device and system contain an imaging 
system that includes a complementary metal oxide semiconductor (CMOS) 
imaging camera. The device also contains an ultra low power radio frequency 
(RF) transmitter for transmitting signals from the CMOS imaging camera to a 

1 0 receiving system. 

The CMOS imaging camera is an ultra low power imager, has low 
sensitivity to the red spectrum and is provided in chip scale packaging (CSP), The 
transmitter is an ultra low power RF transmitter with high bandwidth input, 
possibly provided in chip scale packaging. 

1 5 The high integration and low power consumption achieved by the imaging 

system of the device and system of the invention were unobtainable prior to, the 
advances in CMOS technology. Further, an ultra low power, high bandwidth 
input transmitter for video signals is unknown in the art. Also, an RF product in 
CSP has not been previously disclosed in the art, 

20 Further, the imaging system may utilize a white light emitting diode 

(LED) as a light source rather than a reddish incandescence miniature bulb or an 
RGB LED presently used in the art. The white LED enables to produce a higher 
quality and more pleasant to the eye image, 
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There is therefore provided, in accordance with an embodiment of the 

invention, an in vivo imaging device. Tlie device consists of at least one imaging 

system for producing video output, preferably digital output, and a transmitter 

which transmits the video output to a receiving system. 
5 The imaging system includes a CMOS imaging camera, at least one 

iUumination source for illuminating an in vivo site and an optical system for 

imaging the in vivo site onto the CMOS imaging camera, 

The illumination source may be a white LED- The term 4 *white LED" as 

referred to herein relates to a combination of a blue LED chip (emitting light in 
xQ 10 the blue spectrum range) and a refracting crystal. The blue LED chip is 
O encapsulated within the refracting crystal such that blue light incident on the 

)f. crystal is emitted in different spectrums, resulting in white light. The white light 

^ emitted from the refracting crystal has a small fraction of red light and an even 

j 7j smaller, almost nonexistent, fraction of infra red (DR.) light, 

IB 15 The illumination source may be a specific integrated light source in 

M which a refracting crystal matrix has a plurality of blue LED chips integrated 

therein. 

The components of the device are harbored in a housing having an 
optical window. The housing is configured for being inserted and passing through 
20 body lumens or cavities. 

Also provided, in accordance with an embodiment of the invention, is a 
system for in vivo imaging, which includes an imaging system producing video 
output, preferably digital output a transmitter which transmits the video output of 
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the imaging system and a receiving system for receiving Hie transmitted video 
output Hie imaging system consists of a CMOS imaging camera, an mumination 
source for iUuminating an in vivo site and an optical system for imaging the in 
vivo site onto the CMOS imaging camera. 

5 The system may further comprise an antenna array capable of 

surrounding a body and comprising one or a plurality of antennas for receiving 
the transmitted video output and for producing a plurality of received signals. 
Also the system may include a demodulator capable of tramforming the plurality 
of received video signals into a single video datastream. The system may also 

10 comprise a data processing system which generates tracking and video data from 

the single datastream. 

The receiving system and data processor are typically located outside a 

patient 

Optionally, the system can also include an apparatus for operating the 

15 transmitter intermittently. 

In one embodiment of the invention, the device is a swallowable capsule 
having an optical window and containing an imaging system for obtaining in vivo 
images of the entire length of the GI tract and a transmitter which transmits the 
obtained images to a receiving system. 

20 The imaging system consists of a CMOS imaging camera, a white LED 

and a lens for imaging a GI tract site onto the CMOS imaging camera. The 
swallowable capsule also includes a contained energy source for providing energy 
the entirety of the electrical elements of the capsule. 
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Also provided in accordance with an embodiment of the invention is a 
transmitter for transmitting signals on RF to a receiving system. The transmitter, 
which is controlled by a normally opened (NO) switch, includes a control block 
for controlling the mumination and imager of the device of the invention. 

5 The NO switch is controlled by an external magnet that keeps the switch 

closed while it is in proximity to the switch. However, an internal block maintains 
the logistics of an open switch, so as to keep the transmitter circuits and all 
capsule main subsystems inactive while the external magnet is present Removal 
of the external magnet causes the switch to open and the internal block to close, 

10 thereby allowing the transmitter circuits and capsule main subsystems to be 
activated. 

Further provided is a method for obtaining images in vivo. The method 
includes the steps of: Ulumkaating a site in vivo; collecting remitted light onto 
pixels of a CMOS imaging camera, thereby generating an analog signal; 
15 processing and converting the analog signal to a digital signal; randomizing the 
digital signal; transmitting the digital signal to a receiving system; and processing 
the transmitted signals to obtain images of the in vivo site. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated more fully 
from the following detailed description taken in conjunction with the drawings in 
which: 

Figure 1 is a schematic longitudinal cross section illustration of an in 
vivo imaging device according to an embodiment of the invention; 

Figure 2 is a schematic presentation of the CMOS imaging camera 
according to an embodiment of the invention; 

Figure 3 is a cross section schematic illustration of a device, in 
accordance with an embodiment of the invention, including a specific integrated 
illumination source; 

Figure 4 is a block diagram of the transmitter in accordance with an 

embodiment of the invention; and 

Figure 5 is a block diagram presentation of the method according to an 
embodiment of the invention. 
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DETAILED DESCRIPTION OF THE INVENTION 



The device and system of the invention are utilized for viewing inside 
body lumens and cavities and for transmitting at least video data, 

5 Reference is now made to Fig. 1 which illustrates the device and its 

components, according to an embodiment of the invention. The device 10 
typically comprises an optical window 21 and an imaging system for obtaining 
images from inside a body lumen, such as the GI tract The imaging system 
includes an illumination source 23 3 such as a white LED, a CMOS imaging 

10 camera 24, which detects the images and an optical system 22 which focuses the 
images onto the CMOS imaging camera 24. The illumination source 23 
illuminates the inner portions of the body lumen through optical window 21. 
Device 10 further includes a transmitter 26 and an antenna 27 for transmitting the 
video signal of the CMOS imaging camera 24, and a power source 25, such as a 

15 silver oxide battery, that provides power to the electrical elements of the device 
10. 

It will be appreciated that a plurality of CMOS imaging cameras may be 
used in the device and system of the invention. Each CMOS imaging camera may 
include its own optical system and either one or more illumination sources, in 
20 accordance with specific requirements of the device or system. 

Images obtained by the CMOS camera 24 are transmitted to a receiving 
system (not shown), which may also include a data processing unit The receiving 
system and data processing unit are typically located outside a patient. 
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The device 10 is capsule shaped, can be easily swallowed and may 
passively pass through the entire GI tract, pushed along by natural peristalsis. 

Nonetheless, it should be appreciated that the device may be of any 
shape suitable for being inserted into and passing through a body lumen or cavity, 

5 Furthermore, the device of the invention may be attached or affixed on to an 
instrument that is inserted into body lumens and cavities, such as on an 
endoscope, laparoscope, stent, needle, catheter etc. 

Thus, the device may be introduced into a body lumen or cavity by 
swallowing, by using an endoscopic device, by surgery and so on. 

10 A suitable CMOS imaging camera 24 is, for example, a "camera on a 

chip" type CMOS imager specified by Given Imaging Ltd. of Yokneam, Israel 
and designed by Photobit Corporation of California, USA, with integrated active 
pixel and post processing circuitry (as will be further described with reference to 
Fig. 2). The single chip camera can provide either black and white or color 

15 signals. 

The CMOS imaging camera 24 is designed such that it is less sensitive to 
light in the red spectrum than known CMOS cameras. 

The optical system 22 comprises at least one lens and optionally mirrors 
and/or prisms for collecting and collimating remitted light on to the pixels of the 
20 CMOS imaging camera 24. Typically, the optical system comprises an aspherical 
focussing lens. A suitable lens is, for example, the lens designed by Given 
Imaging Ltd. of Yokueam, Israel, in accordance with specific object plane, 
distortion and resolution parameters, 
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niumSnation source 23 , transmits ihumination to the walls of the body 
lumen via the optical window 21. The lens of the optical system 22 then focuses 
remittent light onto the pixels of the CMOS imaging camera 24. 

A single or plurality of light sources or a specific integrated light source 
may be used and positioned in accordance with specific imaging requirements, 
such as to avoid stray light etc* Also, the optical window 21 may be positioned 
and shaped according to the device shape and according to specific imaging 
requirements. For example, optimized imaging conditions can be obtained when 
optical window 21 is formed to define an ellipsoid shaped dome and the CMOS 
imaging chip camera system 24 and illumination sources 23 are positioned in the 
proximity of the focal plane of the shape defined by the optical dome. Obtaining 
the above imaging conditions is described in WO 00/76391, which is assigned to 
the common assignees of the present invention and which is hereby incorporated 
in its entirety by reference. 

The in vivo sites imaged in the present invention are usually very close to 
the imager. For example, an 1 1 x 30mm capsule passing through and imaging the 
small intestine, images the intestine walls from a very short distance. It is 
therefore possible to satisfy the illumination requirements of the imaging process 
utilizing solid state illumination sources, such as LEDs. 

In an embodiment of the invention the illumination source is a white 
LED. The white light emitted from the white LED has a small fraction of red light 
and even smaller fraction of IR light Hence, a white LED is beneficial for use 
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with silicone based image sensors (such as CMOS imaging cameras) because of 
the silicone sensitivity to red and IR light 

In a system which includes the CMOS imaging camera of the invention 
with its reduced sensitivity to light in the red spectrum and a white LED 
iUurnination source, no IR reject filters (photopic filters) are needed 

A suitable transmitter may comprise a modulator which receives the 
video signal (either digital or analog) from the CMOS imaging camera, a radio 
frequency (RF) amplifier, an impedance matcher and an antenna. The transmitter 
will be further illustrated in Fig. 4. 

Other optional parts of the system as well as the method for localization 
of a capsule coalmining the system within the digestive system may be similar to 
those described in US 5,604,531 (which is assigned to the common assignees of 
the present invention and which is hereby incorporated in its entirety by 
reference). 

Device 10 can additionally include sensor elements for measuring pH, 
temperature, pressure, etc. These sensor elements, some of which are described 
in the prior art, may be any element suitable for measuring conditions prevailing 
in the body lumen (for example, the digestive system) and that are capable of 
being appended to or included in the device. 

Reference is now made to Fig. 2, in which a schematic layout of the 
CMOS imaging camera is presented. The CMOS imaging camera 200 comprises 
active pixel and post processing circuitry on a single chip. The CMOS imaging 
camera 200 includes photo cell 202 (the pixels of the CMOS imaging camera), 
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correlated double sampler (CDS) 204, analog to digital (A/D) converter 206, 
encoding and randomizing unit 208 and timing generator 210 for control and 
synchronization of thte circuitry elements. 

Light collected by an optical system is directed onto CMOS imaging 

5 camera 200 and photons are converted to electrons as the light is absorbed by 
photo cell 202. Electrons are converted to electrical current and an analog signal 
is produced by the active pixel circuitry. Hie analog signal is conveyed for further 
processing by on-chip post processing circuitry. The signal is further processed 
by CDS 204, CDS 204 performs correlated double sampling, for canceling noise 

10 and signal shaping before conveying the signal to the A/D converter 206. The 
A/D converter 206 is a serial output A/D converted which enables serial, low 
power transmission of signals. The signal is converted into a digital signal and is 
farther conveyed to encoding and randomizing unit 208 for defining frame and 
row parameters (encoding) and for priming the signals for transmission 

15 (randomizing). The encoding and randomizing unit 208 randomizes the 
occurrence of the digital "0" and "1" signals such that transmission is not 
impeded by a reoccurring signal of one type. 

The CMOS imaging camera 200 is specified by Given Imaging Ltd. of 
Yokneam, Israel and designed by Photobit Corporation of California, USA, 

20 according to a specification adjusted to in vivo imaging, The CMOS imaging chip 
has ultra low power requirements (less than 3 milliwatts)- The dynamics of the 
increase of dark current generated by the imaging camera, as a function of 
temperature, is less than that of solid state devices known in the art, such that at 
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37°C a low fraction of the out put video signal is dark current Further, as 
discussed above, the imaging camera has reduced sensitivity to light in the red 
spectrum, abating the need for photopic filters. 

Reference is now made to Fig. 3 in which a device for in vivo imaging 
5 comprising a specific integrated light source is illustrated. Device 300 comprises 
CMOS imaging camera 302, an optical system (not shown) for imaging in vivo 
images onto the CMOS imaging camera 302 and an integrated light source 304 
for Ruminating a site in vivo. The device 300 further includes a transmitter 305 
for transmitting video data from the imaging camera 302 to a receiver (not 
t 10 shown). The transmitter 305 generates a high voltage and current source for the 
3 light source 304. The integrated light source 304 is connected to the transmitter 

P 305 through connective wires 301. The electrical components of the device are 

3 powered by a battery contained within the device (not shown). 

1 The integrated light source 304 comprises a strip 306 of a refracting 

1 15 crystal matrix encircling the CMOS imaging camera 302. Blue LED chips 308, 

2 encapsulated within the refracting crystal matrix of strip 306, are positioned along 
the strip 306 such that mumination is provided in a ring around the CMOS 
imaging camera 302. 

Blue LED chips 308 can also be sprinkled throughout the strip 306 such 

20 that the whole strip 306 emits light. 

Reference is now made to Fig. 4 in which a block diagram of the 
transmitter is illustrated. The transmitter 400, an ASIC (application specific 
integrated circuit) designed to fulfill international communication standards (such 
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as the FCC) standards, operates on a minimum shift keying (MSK) modulation 
system to effect transmitting of digital signals through antenna 426 and 427 on 
radio frequencies to a receiving system. The transmitter 400 also controls the 
illumination and imager of the device of the invention and the logical conversion 
of the switch (as described above). The transmitter 400 includes a one time 
programming unit 408 in communication with external programming input 428, a 
control logic block 401 for communicating with, the imager, a phase lock loop 
(PLL) 402 in communication with modulator 425, optionally, a LED power and 
control block 403 for controlling the illumination, a main oscillator 404 and a 
switch 405 which controls an internal electronic switch 406. 

The control logic block 401 communicates with the imager, reads 
preprogrammed parameters and performs the interface to the "outside" world in 
the programming mode. Control logic block 401 maintains a master clock, is 
synchronized by bit rate data 412 and frame rate 413, and through control 411, 
which is generated by the imager, triggers LED power and control block 403- 
Control logic block 401 further controls the master clock 414 and the imager 
shutdown 415, 

During shutdown the transmitter sends out beacon signals only. The 
shutdown enables economic use of the device's power supply. For example, in a 
device designed for imaging the small intestine, the transmitter 400 may be 
programmed to include a two hour delay, during which period shutdown of the 
imager and other device electronics is effected Two hours is approximately the 
time it takes a swallowable device to pass the stomach and enter the small 



13 



P-3112-US 

intestine, in particular patients. Thus, in those patients, the device will utilize 
power from the battery, for collecting images, only when the device has reached 
the small intestine. 

The PLL 402 is a feedback system intended to automatically correct 
drifts in the transmitted frequency. PLL 402 includes a pre-scaler 424 for fast 
frequency dividing that is not dependant on the channel frequency. The pre-scaler 
424 is in communication with a divider 421 that divides the frequency of the 
oscillator 404 to perform the reference frequency for the PLL, The division value 
is channel dependant The PLL 402 also includes a phase frequency detector 
(PFD) 422 for performing the frequency comparison and the phase comparison of 
the PLL, and a charge pump 423 for performing the shape of the loop 
transmission of the whole loop. 

LED power and control block 403 includes a high voltage source 432 
that is controlled by the external capacitor 43 1. LED power and control block 403 
also includes a high current source 433 and the peak current value of the LEDs is 
controlled by the resistor which is connected to LedRes 43 5 . 

The transmitter 400 is controlled by an external magnetic switch 405. 
The switch 405 is a normally opened (NO) switch that is kept closed by an 
external magnet, as described above. Switch 405 controls an internal electronic 
switch 406 that controls all the device electronics. Electronic switch 406 includes 
a low leakage circuitry to convert the logic of the NO switch 405 to formally 
closed" (NC) logic, such that although switch 405 is a NO switch it will keep the 
transmitter inactive while it is closed. 
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The low leakage circuit only uses 1% - 3% of the battery power per year, 
so that the internal electronic switch 406 is not a significant fector in the power 
regimen of the device. 

In an embodiment of the invention the device is a swallowable capsule 

5 having an optical window and comprising a CMOS imaging camera, white LEDs, 
an optical system, a transmitter and battery. The swallowable capsule is kept 
inactive while contained in a package having a magnet, such as the magnetic 
packaging described in PCT application IL00/00752 (which is assigned 1p the 
common assignee of the present invention and which is hereby incorporated in its 

10 entirety by reference). Just prior to use the package having the magnet is removed 
enabling the switch 405 to be opened, thereby activating the transmitter and with 
it, initiating imager and iUumination operation. 

The input bandwidth of the information in the transmitter 400 is over 
1.35Megabit per second. Such a low powered high input bandwidth transmitter 

1 5 for transmitting video data, has not yet been shown in the art. 

Reference is now made to Fig. 5 in which a block diagram of the method 
of the invention is illustrated. The method for in vivo imaging includes the 
following steps: illuminating a site in vivo (502); collecting remitted light onto 
pixels of a CMOS imaging camera, thereby generating an analog signal (504); 

20 converting the analog signal to a digital signal (506); randomizing the digital 
signal (508); transmitting the digital signal to a reviving system (510) and 
processing the transmitted signals to obtain images of the in vivo site (5 12). 
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The step of illumination (502) is preferably carried out by employing 
white LEDs to illuminate the site in vivo, Illumination may be continuous or 
alternating in accordance with specific requirements of the system. 

Collecting light remitted from the site in vivo (504) and directing it on to 
the pixels of a CMOS imaging chip is achieved by employing an optical system 
which comprises a lens and which may further comprise any suitable collimator. 

Conversion of the analog signal to a digital signal (506) is preferably 
effected in a serial manner. 

Randomizing the digital signal (508) 3 namely randomizing the 
occurrence of the digital signals ("0" and C T'% is performed so that transmission 
is not impeded by a reoccurring signal of one type. 

Transmission of the signal (510) is accomplished using radio frequencies 
(approximately 432 - 434 Mhz) at a rate of two to eight frames per second to an 
array of antennas attached to a patient's body. The antennas allow image capture 
and are also used to calculate and indicate the position of the imager in the 
patient's body. An example of the calculation and indication the position of the 
imager in the patient's body is provided in the above mentioned US 5,604,53 1. 

Processing of signals (512) can be carried out by employing suitable 
processors and software. For example, the RAPID software (propriety software 
developed and owned by Given Imaging Ltd, of Yokneam, Israel) is used to 
obtain a video clip of images captured from within the GI tract. The video clip 
can be synchronized with the trajectory of the imaging device as it passes through 
the GI tract to enable localization of the device in the GI tract. 
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Additionally, a plurality of receiving antennas can be used which can be 
moved to the location enabling best receiving conditions. 

Hie images can be stored on a small portable recorder carried on a belt 
and subsequently downloaded for analysis and retrieval. Additionally, the 
receiver can be connected directly to a stationary data recorder. 

Experiments were carried out with an 1 1 x 30 mm capsule comprising a 
CMOS imaging chip and miniature processor, white LED light sources, a short 
focal length lens and a miniature transmitter and antenna. The capsule, powered 
by silver oxide batteries, was swallowed and more than 5 hours of continuous 
recording of images from the gastrointestinal tract were achieved. 

Live transmission of good quality video images were obtained for up to 6 
hour periods in ambulatory dogs, 

With ethical committee approval a human volunteer study was 
performed. The capsule was easily swallowed- Moving images were obtained 
from the stomach and small intestine. No discomfort was experienced- The 
optical window remained clear throughout the whole transmission. 

Trigonometric analysis of signal strength allowed continuous monitoring 
of the capsule position, Imaging of the small bowl was successfully completed in 
2 hours. 

It will be appreciated by persons skilled in the art that the present 
invention is not limited to what has been particularly shown and described 
hereinabove. Rather the scope of the present invention is defined only by the 
claims which follow: 
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